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Abstract 


Before 2017, there aren't standards obligated analytical laboratories even accredited ta take measurement uncertainty into 
account in the decision for acceptation or rejection the samples result toa specification, so the decision of conformity for all 
results closed to specification limits became doubtable. Now in the recent edition af ISO Standard ([SO/IEC 17025:2017) 
decision rules become obligatory for both testing and calibration laboratories, a clause number 7.8.3 tiled “Reporting 
statement of conformity” stated the laboratories shall dacument the decision-rule employed and taking into account the tsk 
level The environmental measurements are critical and mistakes occur indecision lead to adisaster, so this paper concemed 
toexplain different methods of decision-rules used and calculate the risk level relevant to each decision through the practical 
Implementation these decisions by Kafe EL Seikh accredited water laboratory 
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Introduction 


Previous version af ISO standard (180 /IEC 17025:2005) 
recommended only to testing laboratories to write 
2 statement of conformity where necessary for the 
Interpretation ofthe testresuls.Statementaf conformity not 
‘obligatory in this version because this version didn't confirm 
the implementation in terms of the shall and should but it 
‘was mentioned as where relevant (ISO 17025:2005, Clause 
5.10.3.1b) [1]. and there was lake in references that explain 
that, especially for testing laboratories 


On the other hand, recent 180 Standard (1S0/ 
18C:17025/2017) obligated both twsting and calibration 
Taboratories to write the statement of conformity in case 
fof requested by the customers oF the competent authority 
and mentioned that at different postions such as resources 
and processes related to personnel, contract review and 
reporting 


Clause 37, illustrated the definition of the decision- 
rules with conformity, which Is taking the uncertainty of 
measurement into acmunt to stat the conformity with 
2 specified requirement [2]. Clause 626 obligate the 
laboratory to authorized personnel for results analyses 
including the writing of the conformity statement, opinion 
‘nd interpretation. Clause 7.1. requires when the customer 
nels lab to writes statement of conformity toa specification 
‘or standard a binary decision shall be taken ( pass/fail, in 
tolerance/aut-of- tolerance), the specification or standart 
and the decision-nuleshall be defined unambiguously in test 
report or in calibration certificate unless mentioned clearly 
inthe requested spediication or standard, the decision-rule 
selected shall be discussed , and agreed with, the customer 
before the lab initiated customer requests [2-4], Clause 7.83. 
(1c) where applicable, the uncertainty of measurement 
‘written in the same unit as absolute value or a relative 
percentage t the measurand, when the value of uncertainty 
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alfects the validity of the test results, when requested by a 
‘ustomer, or when the uncertainty of measurement affects 
statement of conformity to specifications. Clause 728.61 
When a statement of conformity to a specification or 
standard for test or calibration is required, the laboratory 
shall mentioned the decision-rule used also the risk level 
[like false of acceptation and false of rejection and statistical 
‘assumptions used) which related to the decision-rule used 
2] Clause 7.862 the laboratory shall report the statement 
a conformity dearly to identify which results that statement 
of conformity Implemented; which specifications and 
requirements are compiled or not the decision-rule applied 
{unless itis stated in the speciication or standard used) (2) 


Some analytical laboratories working in the 
environmental field, acceptance and rejection decisions are 
Inaccurate due to they haven't taken uncertainty in their 
decisions due to lack In statistical knowledge. So in this 
paper we explain different methods of decsion-rules used 
‘and associated risk levels with a practical example for each 
method. 


Methods for Determination Risk Levels of 
Decision Rules 


When performing @ measurement and subsequently 
making a statement of conformity, there are two possible 
‘outcomes; correct decision regarding to specification or 
Incorrect decision is regarding to speciieation [5]. 


Figure 1: Level of risk for different laboratories decision. 


‘As shown in Figure 1 The expanded measurement 
uncertainty in the lower result (A) totally les within the 
tolerance limit. The upper result (B) has significantly larger 
measurement uncertainty. The risk of falsely accepting 2 
result In case B ls higher due to the larger measurement 
uncertainty, so using of a guard bands (W) can reduce the 
probability of making an incorrect conformance decision. 
A safety factor bullt into the measurement dedsion to 
reduce the acceptance limit below that af the specification/ 
tolerance limit [5] Thereare four cases ofdecision-rulesthat 
‘alten encountered to the workers in Held of environmental 
laboratories; simple acceptance, upper tolerance limits, 
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lower tolerance limits and double-sided tolerance limit 6,7]. 


—_———_—_—_——_—_—_—_—_—_—_—_EA_ 


| Figure 2a: Guard band for lower tolerance limit decision. 


Figure 2b: Guard band for lower tolerance limit decision. 
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Figure 2c: Guard band for double side tolerance limit 
‘decision, (1) Tolerance/ specification Zone, (2) Acceptance 
Limit, (8) Acceptance Zone, (4) Rejection Zone, (5) Guard 
‘band(W) for lower Tolerance Limit, (6) Guard band(W) 
for Upper Tolerance Limit, (LTL) Lower Tolerance/ 
Specification Limit and (UTL) Upper Tolerance/ 
‘Specification Limit, 


‘This document refers to Guard Bands, where the Guard 
Band (W) equalthe Tolerance specification Limit (TL) minus 
the Acceptance Limit (AL) 


W=TLAL —Eq.(1) 
‘This means that if the measurement result is below 


the Acceptance Limit (AL), the measurement is accepted 
‘8 conforming to specification, If measurement excoed 
‘Acceptance Limit (AL) by the amount less than specific 
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risks provided in the fllowing table are also accepted as 
‘conforming to specification, reject otherwise [8,9 


1 a a TT 


‘Table 1: Specificrisk of decision rules used in environmental laboratories 
EA-Probabilty of False Accept and PER. Probability of False Reject (Assumesasinglesided specification and normal disteibution 


of measurement results) 


Case (1): Simple Acceptance 


Customers ask 2 laboratory to make 2 conformity 
decision that “ignores uncertainty” In case of uncertainty 
Ignorance, the guard band length equal to zero, W = 0, 
infers that acceptance accur when a measurement result 
is below a tolerance limit. This is called simple acceptance 
for shared risk because the probability to be outside the 
tolerance limit may be as high as 50% (risk level is 50%) 
in the case when a measurement result is exacly on the 
tolerance limit (assuming a symmetric normal distfbution 
of the measurements} [10]. According to the accreditation 
requirements this decision is not permitted by ISO/IEC 
17026:2017, which require that uncertainty should be 
taken into account (directly or indirectly) when conformity 
decisions are made [11]. 


Case (2): Single Sided Upper Tolerance Limit 


Conformance probability for an upper tolerance limit is 
theretore 


100- NORM. DIST (TL, y.,SD, TRUE) Eq. (2) 
Where: TLis specification limit, is lab result, 9D standard 
deviation which equal standard uncertainty(u) of the result 
‘with the same unit * fsetor spedified in different types of 
decision rules () Table (1). 


Probability false acceptance PEA (risk level) is 


PFA=100-p, —Eq.(3) 
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Possible decisionrules fortis canformity decision might 
therefore be defined in termsaf conformance probabiliy( p) 
‘or probability alse acceptance (PEA) (11,12). 


Example: What is the lab decision of compliance with 
the WHO specification for measuring iron in drinking 
‘water sample, while the sample result is 0.28 mg/l, WHO 
specification limit is 03 mg/l, expanded uncertainty 
associated with measuring of iron in this lab Is #8%, lab 
using ILAC-G8 decision-rule Table (1)- 


Answer: Decision-tule lab used is ILAC-G8, where guard 
band length equal 1* Expanded uncertainty(U) and the 
‘accept risk level is «2.59% so the result ACCEPT when pe 
975 %; REJECT otherwise or equivalently, also the result 
ACCEPT when PFA 25 34; REJECT otherwise” 


Frist of all calculate standard uncertainty(u) with the 
‘same unit of measurand by applying the following equation 
pany 


Star uncer (0) = 
Kavemge wee ( 


eq(4) 


Standard uncertinty (u)=#0.01121/1 
Standard deviation (SD}=F*u=1°0.0112=20.0112 mg/l 
By appying the valuesof: speifiaton init Th, abresulty, 
Standard deviation SD in Conformance prabablity (.) Eq 
(2),using Excl program 

P,= 100-NORM. DIST (0.3 0:28, 0.0112, TRUE) =96.20% 
Ceulation probability false acceptance using Eq. (3). 


PFA= 100 -p,=3.71% 
‘This result might therefore be reported as 


“REJECT, with a conformance probability of only 96.29% 
‘which does not meet acceptance criterion ofp, = 97.5%" oF 
“REJECT witha probability false acceptance of 3.71%, unable 
to meet acceptance criterion af PPA.< 2534" 


‘case (3): Single Sided Lower Tolerance Limit 


Canformance probability(p) for lower tolerance Hit is 
therefore (11,12) 


p,= NORM. DIST (TL, y,, SD, TRUE}EQ. (6) 
Probability false aceptance PEA (ik level) is 


PEA=100-PFA—Eq.(7) 
Example: Dissolved oxygen(0,) of treated sewage plant 
was 42 mg/L as 0, specification limit lab follows to 
determine statement of conformance is Ont less than 4 
mg/l expanded uncertain associated with O, measuring 
is 26% and the decisions rule lab always uses is ISO 14253 
1:2017(5} Table (1). 


Answer: Decision-rule which lab use is ISO 14253 
1:2017[5] where guard band length equal 083° expanded 
luncertainty(U) and the accept risk level is < 5.0% so the 
result ACCEPT when pe 2 95.0 % REJECT otherwise or 
‘equivalently, also the result ACCEPT when PPA < 5.0 %; 
REJECT otherwise Calculate standard uncertainty(u) as the 
previous example 


u= £0.126mg/1 
Standard deviation (SD)= 0.83 * u= 0.83 * 0:126= 20.108 
mg/l 

1p, =NORM. DIST (4, 4.2, 0.104, TRUE) = 97.21% 
PFA=2.79% 


‘This result might therefore be reported as 
‘Accepted, with a conformance probability (pe) of only 
97.21% which meet acceptance criterion of pe > 95.0%" or 
“accepted with a probability false acceptance of 2.79%, meet, 
acceptance criterion of PEA < 5.096" 


Case (4): Double Sided Tolerance Limit 


Conformance probability for a two-sided tolerance limit is 
therefore. 

P= NORM. DIST (TLgay Yor SD, TRUE) ~ NORM. DIST 
(Ch Yq SD, TRUE) Eq. (8) 
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Decision Rules for this conformity might thereforebe defined 
Interms of pe or PFA [12-14] 

Example: Dissolved oxygen(0,) of a river was 22 mg/L as 
0, dissolved axygen needed for ish wing ranges from 2-6 
mg/l-expanded uncertainty assodated with O, measurement 
ig 26% and the decisions rule lab always uses is 3 Sigma 
Table (1). 


Answer: Decision-rule whieh lab used is 3 Sigma where 
‘guard band length equal 

1.5* expanded uncertainty(U) and the accept risk level is 
<0.16% so the result ACCEPT when pe 2 99.84 9; REJECT 
atherwise or equivalently, also the result ACCEPT when PFA 
< 0.16%; REJECT otherwise” 

Calculate standard uncertainty asthe previous examples 

= £ 0.066 mg/l 

Standard deviation (SD)= 15 * 


15 *0,07= 20.10 mg/l 
1p, = NORM. DIST (6, 2.2, 0.10, TRUE) -NORM, DIST (2, 2.2, 
(0:10, TRUE) = 97.83% 

PERE 2.17% 


‘This result might therefore be reported as 
“REJECT, with a conformance probability of only 97.83% 
which docs not meet acceptance criterion ofpe= 99.84%" or 
“REJECT with probability falseacceptance of 2.17%, unable 
to meet acceptance criterion of PEA 0.16 %" 


Conclusion 


Laboratories working in the environment field: must 
accurately determine the uncertainty values associated 
‘with the tests results due to its extreme importance it the 
diferent decision-rules and also, they must apply decision- 
rules methods whether or not they are internationally 
accredited unless itis inherentin the requested specification, 
standard. 


Highlights 


‘This paper concerned to explain different methods of 
decision-rules used and calculate the risk level relevant to 
‘each decision through the practical implementation these 
decisions by Kafe EL Seikh accredited water laboratory 
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